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MODEL  REFERENCE  ADAPTIVE  CONTROL  SYSTEMS:  THE  HYBRID  APPROACH 


I 


R.  Crlsti,  R.V.  Monopoll 


Electrical  and  Computer  Engineering  Department 
University  of  Massachusetts 
Amherst,  Massachusetts 


In  this  report,  an  algorithm  for  adaptive 
control  of  continuous  time  single-input  single¬ 
output  systems  Is  presented.  With  the  hybrid 
approach,  the  control  structure  Involves  a 
continuous  as  well  as  a  discrete  time  part, 
Instead  of  being  totally  discrete  or  totally 
continuous  as  In  previous  approaches. 

The  system  Is  sampled  and  the  adaptive  gains 
updated  at  a  variable  rate  varying  with  the 
magnitude  of  the  error  Itself. 


Introduction 


The  theory  and  application  of  Adaptive 
Control  Systems  have  been  a  center  of  discussion 
In  the  last  few  years.  Continuous- time  [1],  [6], 
[7],  [8],  as  well  as  discrete-time  [2],  [5],  [9J, 
[10]  schemes  have  been  devised,  and  stability  has 
been  proved. 

In  spite  of  the  continuous-time  nature  of 
real  systems,  from  a  point  of  view  of  applica¬ 
tions,  discrete- time  algorithms  are  preferred  to 
continuous- time,  due  to  recent  advances  In  digital 
technology. 

However,  the  discrete  approach  Is  not  closely 
coupled  to  the  continuous-time  behavior  of  real 
plants,  making  a  "hybrid"  approach  (partly  dis¬ 
crete,  pertly  continuous)  desirable.  It  Is  a  well 
known  result  [1],  [6],  that,  for  a  given  plant, 
poles  and  seroes  can  be  arbitrarily  placed  with 
appropriate  compensators  as  In  Fig.  1.  If  the 
plant  parameters  are  known  exactly,  then  the 
control  Input  which  gives  the  desired  behavior  Is 
of  the  form  _ 

.  "(*)  *J£T  1(0. 

l(t)  being  filtered  versions  of  the  plant  Input 
and  output,  and  K*  an  array  of  constants.  In 
case  of  plant  unknown,  or  partially  known,  the 
input  assumes  the  form 

u(t)  •  £(t)T  *<t). 

where  K(t)  are  adapted  In  order  to  have  K(tHC*. 

In  the  hybrid  scheme  which  will  bo  the 
subject  of  this  paper,  the  set  of  par-ton  K(t) 
are  updated  by  a  digital  coaputer  at  discrete 
Intervals  of  time  (tk),  and  the  continuous-time 
nature  of  u(t)  Is  preserved. 

The  overall  scheme  of  the  control  system  Is 
shown  In  Fig.  2. 

Recently,  hybrid  algorithms  for  adaptive 
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control  [4]  as  well  as  self-tuning  regulators  [11] 
have  been  devised.  In  [4]  the  adaptive  gains  K(t) 
are  discretely  updated  at  a  fixed  rata.  In  base 
of  samples  taken  from  the  plant  In  a  random 
fashion. 

It  turns  out  that  the  sampling  scheme  Is 
crucial  In  order  to  establish  stability  of  the 
closed  loop  system.  In  this  paper,  the  system 
is  sampled,  and  the  adaptive  gains  updated,  at  a 
variable  rate  according  to  the  magnitude  of  the 
continuous  time  error  Itself.  It  Is  shown  that 
the  continuous  time  error  becomes  —Her  than 
any  bound,  arbitrarily  determined,  after  a  finite 
number  of  adaptation  steps. 

The  problem  Is  stated  In  Section  1,  with  the 
error  model  In  Section  2.  The  adaptive  law  Is 
discussed  In  Section  3,  and  Section  4  describes 
the  sampling  scheme,  with  proof  of  stability. 


Notation 


The  following  notation  will  be  used: 

-  vectors:  a  -  [as,  a^ . a„]T; 

-  time  delay  operator:  a; 

-  differential  operator 


9 

x(t)  •  0[y(t)]  Iff  there  exists  a  positive 
constant  M  such  that  |x(t)|  <  M|y(t)|, 
for  any  t; 


-  x(t) 
for  » 


o[y(t)]  Iff 
function 


.lisa'll?}]., 

0[y(t)]  and 


-  £  denotes  L .pi ace  Transform  operation. 


L  5tat|mgnt.q.f  jm±a»lC 

A  continuous  time  dynamic  system  (plant)  can 
be  described  by  the  linear  time  Invariant,  non- 
autononows  differential  equation 
(1.1)  ipip)  x(t)  «  Mp)  «(t)  . 
with  Op(p)  •  p"  ♦  a^p*"1  ♦  ...  ♦  a„ 

Mp)  ■  bp^  ♦ 

The  following  asswaptlons  are  made  on  the 
plant  per— tors: 

(1)  the  values  of  a  ,  1*1,  ....  n  and  bg,  1*0, 
.  n,  are  unknown} 

(II)  m  «  n-1  Is  known; 

(III)  the  plant  Is  mini—  phase;  1.e.,  the  poly¬ 
nomial  Mp)  Is  Hwrwltz; 

(1 v)  the  sign  of  bo  Is  known,  as  are  bounds  bom 
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amt  holt,  w* mre  bgM  >  ho  >  b<*. 

Without  lots  of  gonefollty,  bom  >  0  trill  bo 


61 von  «  model 

0-2)  fc(p)  *dty»  Kor(t), 
with  Cb(n)  •  pn  ♦  a»ip«-l  ♦  ...  '♦  on*  Hunritx, 
tfM  dealer  objective  It  to  determine  m  Input  to 
the  plant  u(t)  such  that,  for  sow  Eo  >  0,  tf  >  0 
0.3)  |e(t)|A  Eo.  for  every  1 1  tp. 


0.3')  o(t)  *  *(t)  -  x(t) 

In  particular,  wo  rostrlct  tha  Input  u(t)  to  ba  of 
tha  font  n 

(1.*)  u(t)  -  |  Kl(k)pl(t).  for  t«Ctk.  ) 

whara  K  (k),  1*1.  2,  ...  n  It  a  sat  of  gains 
updated  only  at  discrete  Instants  {tt>,  and  **{t) 
art  continuous  tlM.  obsarvabla  stata  variables  of 
tha  system. 


It  has  boon  shown  In  [1]  that  constant 
Motors  &  and  a*  exist  such  that 

(2.1)  Qo(p)o(t)  •  OW(p)C-houf(t)  *  SufcjU)  ♦ 
AtTix(t)  ♦  W*>] 

whara  tha  following  definitions  pertain: 

-  OW(P)  a  P""T  +  cjp"”2  ♦  ...  ♦  co_i  Is  a 
Hunritx  polynomial  such  that  0^(p)  It  Strictly 

0Up) 

Positive  Real  (S.P.R.); 

-  iif(t)  Is  such  that  Of(p)uf(t)  -  u(t)  where 

Of(p)  «  pn-«-1  f.p«-«-2  ♦  ...  ♦  F-  ,  i  is  any 

Hunritx  polynomial  of  degree  rue-1 ; 

-  Ou'(t).  1*0.  ....  n-2  are  solutions  of 
MPjOftpKUt)  -  pMt); 

-  fx'(t),  1-0.  ....  n-1  are  solutions  of 

0C(p)Of(p)Ox1(t)  -  P'x(t); 

-  Po(t)  It  solution  of  a^(p)ao(t)  •  r(t). 
tf  wo  choose  Ob(p)  *  (p*«)JV(p),  with  a  >  0,  a 

-  &,T(ku  (t)  ♦  J5KT(k)*5CCt)  ♦ 

*p(Wfo(2)  *  »l(*)*  t*Ctk» 
wa  can  write  (Z.i)  as  •  r 


<P*»)  ij(t)  •  gj(t),  J  •  o.u.x; 

®l(k )  •ftk  «*P  -«(tk-t)wi(t)d(T) 

*'tk-l 

Introducing  tha  auxiliary  network 

(2.6)  y(k)  •  Afcy(k-1)  ♦  q(k)  ♦  w(k) 

with  n(k)  ■  a^)  ay(k),  aquations  (2.4)  and 
(2.6)  yield  „ 

(2.7)  n(k)  -  An(k-l)  +  iT(k-l)  i(k)  ♦  w(k)- 
ho#l(k)  ♦  q(k) 


,  ,  iT(k)  J  [^(k)  a/fk)  <o(k)]. 

(2.6)  jjk)  4gJT(k)  £(k)  60(k)] 

Let  us  choose 

(2.9)  w(k)  •  ^(k-lhhtk). 

X*m  (lllO)b*OT-  Afc(k-I)  +  «J(k-l)  £(k)  * 
Mk-IXhtk)  ♦  q(k). 
which  Is  tha  augasntad  error  equation. 

3.  Adaptive  Law 

Tha  aquations  In  tha  previous  section  hold 
for  any  stapling  sequence  (UK  on  which  no 
hypothesis  has  bean  wade  so  far. 

If  wa  suppose  (tk}  be  a  sequence  with  an 
Infinite  number  of  elements,  then  It  Is  a  well 
known  result— [2],  [3]— that  equation  (2.10)  and 
the  following  adaptive  law 

«w(k)  •  «w(k-l)  ♦  ^(k)  n(k) 

with  F  •  dlag  d»  ,  1  •  1,H),  t  >  1/2  min  (A«,  »*), 

Yi»  >  0.  yield  (£(k)}  be  a  uniformly  bounded 
sequence,  and  moreover 

(3.2)  11m  n(k)  -  0 

(3.3)  11m  i(k)  n(k)  -  0 

h« 

Let  us  define  the  control  Input  as 

(3.4)  u(t)  -Y(k)  i(t).  t  c  E*k.  W 


"  “(2’?)t*&)i(“  -  4  T(kU  (t)  ♦  |wT(k)^(th  (3.5)  i(t)  i  Br(n-m-l)  i(t)5 

_ _ _  «»*•»  A-A  <w  -“S5,(,5  W S3  Wie. 

where  4i(k)  *  Ki(k)  -  bell,  i  •  u.x.o.  •  .  r*. 


«o(k)f0(t)  -  bohi(t).  fbr  tettk.  tfcai) 
where  U(k)  *5j(k)  *  bo|j,  j  •  u.x.o. 

In  whet  follows,  the  sequences  £j(k)  will  be 
called  the  Adaptive  lain,  and  will  be  updated  at  • 
the  sampling' Instants  (t*)  only.  Furthermore,  the 
Input  u(t)  has  to  be  determined  such  that  (1.3)  It 
satisfied. 

If  (2.3)  Is  sampled  at  Instants  (tk>.  the 
samples  of  the  error  wo  related  by  the  linear, 
time  variant  difference  equation  _ 

(2.4)  e(tk)  •  hfct(tk.i)  ♦  i,T(k-l)L(k)  * 

l.T(fc-l)i*(k)  ♦  loEk-TW^k) 1  boAl(k) 
where  we  deftme 
Tk  •  «k  -  «fc-is 

4k  •  «p(-mTk)j 

(2.9)  |j(k)  •  |^(*k)  *  \.j  Xj(tk.))» 

i  •  O.UftXt 


t  *  [tk>  tfc+i), 

which,  together  with  (2.9),  gives  the  remaining 
Input  to  the  auxiliary  network 

(3.7)  *,(k)  -  tyk)  -iT(k-i)  £{k) 

(3.9)  Mk)  •  ^  «P  -o(tk-t)  Uf(t)  dt. 

*k-l 


bound  in  an  osdllatlne  fbshlen,  we  might  cho 
(ta)  such  that  n(k)  ■  0  for  every  k,  and  the 
gem  never  be  updated. 


A  sufficient  requirement  on  the  sanding 
saquanca  cm  bn  stated  as  follows: 

Theorem  ».l.  Let  the  smiling  sequence  {tv}  have 
WUfSlW  nunber  of  terns,  and  be  such  that 

(4.1)  sup  |e(e)[  ■  0Csup|e(tn)(]. 

S<tfc  IKfc 

Then  the  hybnd  systas  described  In  the  previous 
sections  Is  uirlforuly  stable  and 

(4.2)  !1a  e(tv)  »  0 

IlM, 

Proof:  see  £12]. 

The  central  Idea  contained  In  Theoreu  4.1  Is 
that  stability  of  the  overall  systeu  Is  guaranteed 
If  the  sanded  error  (n(tk)}  grow  at  the  sue 
rate  as  the  continuous  tine  error  Itself— as 
stated  In  (4.1). 

Notice  that  the  random  swollng  scheme 
discussed  In  C*I  satisfies  (470— as  In  [4.  Ism 
2]— and  then  cm  be  fsdeuuntnd  to  obtain 
stability  In  an  aluost  sure  sense. 

In  what  follows  a  variable  rate  sampling 
scheme  will  be  discussed.  In  Mich  the  sampling 
Instants  are  determined  by  the  comparison  of  a 
filtered  version  of  the  error  with  Me  error 
Itself. 

Let  c(.)  be  such  that 

(4.3)  .(t)  ^  co  f  *  **(*»>  I  e(v)|dt 

*0 

with 

(4.4)  0  «  Co  «  X  *  Retail .  1*1,  ....  2n*1, 
and  (*i.  1-1.  2n-1}  being  the  zeroes  of  the 
Hunritz  polynomial  Oh(s)Or(s)Oo(s).  Then  the 
following  cm  be  proved: 

Theorem  4.2.  If  the  sampling  sequence  {tk}  Is 
chosen  seen  that  , 

(4.5)  t|,*i  •  arin  {tj|e(r)|>  nax  (Eq.  e(r))} 

»*VT 

with  Ep,  T  arbitrary  positive  constants,  and  e(>) 
as  In  (4.3),  then  tan  Hybrid  Adaptive  Control 
System  discussed  In  the  previous  sections  has  the 
following  properties: 

1)  the  error  |e(*)|  Is  uniformly  bounded; 

11)  the  sampling  sequence  (tk>  Is  a  finite 

111)  an'lnstant  t*  exists  such  that 

(4.*)  |e(t)|  <  Ip,  for  every  t  >  tp. 

Before  going  Into  the  details  of  this  Theorem 
some  technical  1  manes  need  to  be  proved.  An 
exaMla  of  sequence  as  in  (4.1)  Is  shown  in  Fig. 


If  the  error  { e( > } |  grows  without 
(tk)  as  In  (4.5)  Is  m  Infinite 


frdof.  Suppope  {tv}  Is  a  finite  sequence.  Then 
an  integer  N  exists  such  that 

(4.7)  |e(t)|  «  um  (I,,  e(t)J,  for  t>t*T. 
Conhlnlny  this  with  (4.3)  we  obtain,  for  t>t|frT 

(4.S)  *(t)  <-  x  c(t)  ♦  Cn  nax  (Ke>  e(t)). 
inequelltlM "(4.B),  (4.7),  (4.4)  cMtredlct 
thr  error  growing  without  bounds. 


(Cj}  Mists  such  that 

(4.9)  |e(tj)|  ■  sup  |e(t)| 

0  «  |h(*j)l  *  |e(Cjvl)l 
Moreover,  let  us  define  a  sequence  of 
'  Integers  {k«}  such  that 

(4.1or  tkj.,  <  Cj  <  tkj 

with  {tk}  as  In  (4.5). 

Then  we  cm  prove  the  following 
.  Lmmm  A.Z.  For  {t^}  as  In  (4.10)  we  cm  write 

:  <4.11)  |e(tkj)|  >.Mo  r* kj  |e(tj)| 

.  for  som  constant  Me  >  0,  x  as  In  (4.4)  and 
Tk  ■  *k  -  tfc-i. 

Proof.  The  definition  of  (tk)  In  (4.5)  laplles 
that,  for  every  sampling  Instant 

(4.12)  |e(tfc)|  >  «(tk). 

Combining  this  with  (4.3)  we  obtain 

(4.13)  (e(tkj)|  >  Cq  «'*Tkj |e(t)(dv. 

tkj.i 

The  adaptive  gains  being  bounded  and  the  error 
growing  without  bound  yields  the  Inequalities 

(4.14)  |e(t)J  ^Mf  sup  |e(t)| 

t«t 

'fbr  som  positive  constantly ,  and 

(4.15) ^^  |e(t)|dt  >  ^mln  (Jp  Tkj)  |e(«j)|. 

Finally,  Inequalities  (4.13),  (4.15)  and 
>  T  prove  the  lmraa. 

Lmmm  4.3.  If  the  error  grows  without  bound  then 
CM  sequence  (Tv,}  Is  uniformly  bounded. 

Proof.  By  equations  (1.3),  (2.4),  (2.7)  the 
saupled  error  at  Instant  tkj  satisfies  the  equation 

(4.15)  e(tkj)  •  a**Tk4  o(tkj-l)  -  n(kj)  ♦ 

e-TkJ  n(kj-l)  ♦  w(kj)  ♦  y||i(kj)||*  n(kj) 
It  Is  shown  In  fl2J  that 

.  (4.17)  |w(kj)  Ili(kj)||*n(kj)|  il(J)|e(ij)| 
for  som  sequence  {*(4)}  such  that  11m  l(JH>. 

Furthermore,  by  (4.10),  (4.9)  end  (4.11),  the 
fallowing  Inequality  holds  .  , 

(4.15)  |e(tkj-i )  |  <  l*(Cj)l  <  ^  •*T*tj|e(tkj)  I 

Combining  oquatlOM  (4.15),  (4.17),  (4.'I8)  we 

(4J9)  |e(tkj)|  «jj^  e'(*“x)TkJ  ♦  »U)J|e<tk4)| 

♦  |n(kj)|  ♦  h(kj-1)| 

where  n  •  x  »  0  by  (4.4).  By  the  result  in  (3.2), 
and  being  |e(tk)|  »  Cq  *  0,  beundedMos  of 

fsllowe  frm  inequality  (4.19). 


In  the  following  1m 
obtained  dun  the  error  < 
Is  the  esse,  an  infinite 


her  results  are 

wnded.  If  this 

»  ~  ~  - 

Of  IMtMtl 


Proof  of  Tlweram  4.2.  Let  us  suppose  the  error 
let* )  growf  without  bound.  Then  the  sequeneo 
tk«}  as  1n(4.10)  is  m  Infinite  soquonce,  and  by 
Idas  4.2  and  4.3  the  singled  error  satltflM 
(4.1).  Bot  Thuoram  4.1  contradicts  the  error 


growing  without  bound.  Thun  1)  Is  proved. 


To  prove  it)  suppose  too  stapling  sopusnes 
{tk>  to  be  an  Infinite  sequence.  If  this  Is  the 
cue.  by  Theorun  4.1  equation  (4.2)  holds,  which 
contradicts  with  the  fact  that  |e(tb)|>E0>O  for 
every  k.  Thu  {tk}  cannot  bo  «  Infinite  sequence. 

finally  111)  cones  froa  the  fbet  that,  by  11). 
w  Instant  t*  exists  such  that 

(4.20)  le(t)|  *  ux  (Eg,  c(t)l.  fdr  every  t>t*. 
Coehlnlng  (4.20)  with  (4.3]  we  obtain 

(4.21)  «(t)  <  -  x  «{t)  ♦  Co  nax  (Eq,  *(t)).  t>t* 
and  then  an  Instant  te  >  t*  exists  such  that 

(4.22)  e(t)  <  Eo.  far  every  t»t* 

Inequalities  (4.21)  and  (4.22)  prove  the  lut 

part  of  Thsoran  4.1 . 

qra 

figsimigg. 

An  algorithm  for  hybrid  adaptive  control  far 
single-input,  single-output  system  has  been 
dtscrlbtd. 

The  gains  era  updated  at  a  variable  rate,  and 
the  arinlnuB  tine  between  sanples  can  be  set 
arbitrarily  large.  Uni  fore  stability  of  the 
closed  loop  systen  Is  guaranteed,  and  the  eagnl- 
tude  of  the  error  can  be  driven  sea  Her  than  an 
arbitrary  threshold.  In  a  finite  nueber  of  adap¬ 
tation  steps. 

Nothing  Ims  been  Mid  on  the  performance  of 
the  algor) tin  In  presence  of  disturbances  and 
(modeled  dynamics,  which  Is  the  subject  of 
currant  research. 
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